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IN THF.rT AITVrS 

1 . (Cuirently Amended) A method of registering a 2D (two-dimensional) x-ray image of a 
target with previoiisly generated 3D (three-dimensional) scan data of said target, said x-ray 
image being characterized by an image plane defined by mutually orthogonal x- and y- 
coordinates, the method comprisLng: 

A. generating at least one reconstructed image firom said 3D scan data, said reconstructed 
image also characterized by the same image plane;-aftd 

B. determining the value of in-plane transformation parameters (x, y, ^) and out-of-plane 
rotational parameters (r, ((> ) for registering said reconstructed image onto said x-ray image, said 
in-plane and out-of-plaite parameters representing a difference in the position of the target as 
shown in said x-iay image as compared to the position of the target as shown by said image 
reconstructed from said 3D scan data; 

wherein r and ^ represent rotations of said target about first and second mutually 
orthogonal axes, said rotations being out-of-planc with respect to said image plane, said out-of-^ 
plane rotations representing a projection of said target onto said image plane; 

wherein x and y represent an amount of translation of said target within said image plane 
in the directions of said x- and y- axes, respectively, and 9 represents an amount of rotation of 
said target within said image plane about an axis perpendicular to both said x- and said y- axes; 
and wherein step B comprises: 

a. obtaining an initial estimate for said in-plane transformation parameters (x, y» 9) by 
multi-level matching in 3D (three dimensions), between said x-ray image and said reconstructed 
image; 

b. based on said in-plane transformation parameters (x, y, ^) estimated in step a, performing 
an initial search in one dimension (ID) for each pair of out-of-plane rotation parameters (r, ); 
and 

c. iteratively refining said in-plane transformation parameters (x, y, ^) and said out-of-plane 
rotational parameters (r,^), imtil said in-plane and out-of-plane parameters converge to a desired 
accurac y: and 

C. ali ^inR a radiation source to the target using the values of the in-plane transformation 
parameters and the out-of-plane rotational parameters . 
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2. (Original) A method in accordance wilh daim 1, wherein said 3D multi -level matching is 
performed sequentially in each of a succession of a plurality of image resolution levels, starting 
at the lowest resolution level and ending at the highest resolution level. 

3. (Previously Presented) A method in accordance with claim 1, further wherein said 2D x-ray 
image of said target is obtained by transmitting throu^ said target an imaging beam having a 
known position and angle relative to said target, and wherein said Teconstracted image is a 2D 
synthesized DRR (digitally reconstructed radiographs) representing a radiographic image of said 
target that would be obtained with said imaging beam at said known position and angle» if said 
target were positioned in accordance with said 3D scan data. 

4. (Previously Presented) A method in accordance with claim 1 , wherein determining the value of 
in-plane transformation parameters oomprises: 

A. determining a plurality VI, and N ^ of out-of-plane rotation angles, respectively, for said 
rotational parameters (r, and 

B. generating a plurality Nr * N ^ of 2D reference images, one reference image for each of 
said plurality Nr and N ^ of said out-of-plane rotation angles. 

5. (Original) A method in accordance with claim 1, fbither oompiising the step of generating 
offline, before step a, a plurality of in-plane rotated 2D reference images, by performing a series 
of in-plane rotations on said reconstructed image. 

6. (Original) A method in accordance with claim 5, wherein said 3D matching process in step a 
is performed upon said in-plane rotated 2D refer^ce images. 

7. (Original) A method in accordance with claim 1 , wherein said 3D matching process in step a 
is performed using a similarity measure method. 
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8. (Original) A method in accordance with claim 7, wherein said similarity measure method is 
based on a sum of absolute differences. 

9. (Original) A method in accordance with claim 1 , wherein step c of iteiatively refining said in- 
plane and out-of-plane parameters comprises: 

d. refining the in-plane translation parameters (x, y), to increase the accuracy of said 
parameters; 

e. refining the in-plane rotation parameter (0) based on said out-of-plane rotation 
parameters (r, ^) searched in step and on said refined in-plane transfomiation parameters (x, 
y) firom step d; 

f. separately refining each of the out-of-plane rotation parameters (r, ^ ), based on said 
refined in-plane translation parameters from step d, and said refined rotation parameter fi-om step 
e; 

g. iteratively and sequentially repeating steps d, e, and f, until a predetermined accuracy is 
reached; and 

h. refining once more said out-of-plane rotation parameters (r, ^ ). 

10. (Original) A method in accordance with claim 9, who-ein step d of initially refining the in- 
plane translation parameters is performed by sub-pixel matching in two dimensions. 

1 1 . (Previously Presented) A method in accordance with claim 9, wherein step e of refining the 
in-plane rotation parameter is performed by ID (one dimensional) interpolation. 

12. (Original) A method in accordance with claim 9, wherein step f of separately refining said 
out-of-planc rotation parameters is performed through a ID (one dimensional) search. 

13. (Original) A method in accordance with claim 9, wherein step h of refining said out-of-plane 
rotation parameters (r, ^) 'is performed by ID interpolation. 

14. (Previously Presented) A method in accordance with claim 1 , wherein said accuracy is 
sufficient to achieve a resolution of less than about 1 mm. 
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15. (Original) A method in accordance with claim 1, wherein said 3D scan data comprise at 
least one of CT scan data, MRI scan data, and PET (positron emission tomography) data. 

16. (Original) A method in accordance with claim 1, wherein said 1 D search for said out-of- 
plane rotation parameters in step b is performed using a similarity measure. 

17. (Original) A method in accordance with claim 1 6, wherein said similarity measure is based 
on pattem intensity. 

1 8. (Previously Presented) A method in accordance with claim 1, wherein search space for said 
1 D search in step b is the fidl search range of out-of-plane rotation angles, and said full search 
range is sampled by one degree increments. 

19. (Original) A method in accordance witfi claim 9, wherein steps d, e, and f arc pertbrmed 
using a similarity measure based on pattem intensity. 

20. (Previously Presented) A method in accordance with claim 1 , further comprising the step of 
processing said 2D x-ray image, after step A and before step B, so as to match tfie orientation, 
image size, and bit depth of said x-ray image with the orientation, image size, and bit depth of 
said reconstructed image. 

2 1 . (Previously Presented) A system for registering at least one 2D radiographic image of a 
target with at least one image reconstructed from previously generated 3D scan data of said 
target, said radiographic image being characterized by an image plane defined by mutually 
orthogonal x- and y- axes, the system comprising: 

a. means for providing said 3D scan data of said target; 

b. a radiation source for generating at least one radiographic imaging beam having a known 
int^ity, and having a known location and angle relative to said target; 

c. an imaging system for generating a 2D radiographic image of said target in near real 
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time; and 

d. a controller, including: 

i) means for generating said at least one reconstructed 2D image of said target, using 
said 3D scan data, and using said known location, angle, and intensity of said imaging beam; and 

ii) software for determining a set of in-plane transfonnation parameters (x, y, ^ ) and 
out'Of-plane rotational parameters (r. said in-plane and out-of-plane parameters representing 
a difference in the position of the target as shown in said radiographic image as compared to the 
position of the target as shown by said 2D reconstructed image[[s]]; 

wherein said software comprises means for performing a 3D multi-level matching to 
determine an initial estimate for said in-plane transformation parameters (x, y, 0); 

wherein r and ^ represent rotations of said target about first and second mutually 
orthogonal axes, said rotations being out-of-plane with respect to said image plane, said out-of- 
plane rotations rqpresenting a projection of said target onto said image plane; and 

wherein x and y represent an amount of translation of said target within said image plane 
in the directions of said x- and y- axes, respectively, and 0 represents an amount of rotation of 
said target within said image plane about an axis perpendicular to both said x- and said y- axes. 

22. (Previously Presented) A system in accordance with claim 21 , wherein said software for 
determining said in-plane and out-of-plane rotational parameters comprises: 

means for performing a ID search for each of the pair of out-of-plane rotation parameters 
(r, ^) based on said initially estimated in-plane parameters (x, y, 0), and 

means for iteratively refining said in-plane parameters (x, y, ^) and said out-of-plane 
parameters. (r,<4), until a desired accuracy is reached. 

23. (Original) A system in accordance with claim 21 , wherein said radiation source comprises 
an x-ray source, said 2D radiographic image comprises a 2D x-ray image, and said reconstructed 
image comprises a 2D DRR. 

24. (Original) A system in accordance with claim 21, wherein said controller further comprises: 
A. means for determining a plurality Nr and N^^ of out-of-plane rotation angles, respectively, 
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for said rotational parameters (r, (P ); and 

B. means for generating a plurality Nr* Nq, of 2D reference images, one reference image for 
each of said plurality Nr and Nt^f said out-of-plane rotation angles. 

25. (Original) A system in accordance with claim 21 , wherein said controller fuifher comprises 
means for generating offline a plurality of in-plane rotated 2D reference images by peiforraing a 
series of in-plane rotations on said reconstructed image. 

26. (Original) A systan in accordance with claim 22, wherein said 3D multi-level matdung 
means performs sequentially in each of a succession of a plurality of resolution levels, starting at 
the lowest resolution level and ending at the highest resolution levd. 

27. (Original) A system in accordance with claim 22, wherein said 3D multi-level matching 
means comprises similarity measure means based on a sum of absolute differences. 

28. (Original) A system in accordance with claim 22, wherein said means for iteratively 
refining said in-plane and out-of-plane parameters comprises: 

d. means for refining the in-plane translation parameters (x, y), to increase the accuracy of 
said parameters; 

e. means for refining the in-plane rotation paramet^ ( ^ ) based on said out-of-plane rotation 
parameters (r, ^ ) searched in step b, and on said refined in-plane transfomiation parameters (x, 
y) from step d; 

f. means for separately refining each of the out-of-pl ane rotation parameters (r, ^ ), based on 
said refined in-plane translation parameters fixmi step d, and said refined rotation parameter firom 
step e; and 

g. means for iteratively and sequentially repeating steps d, e, and f, until a predetermined 
accuracy is reached, and for refining once 

more said out-of-plane rotation parameters (r, f5 ). 

29. (Original) A system in accordance with claim 22, wherein said means for refining the in- 
plane translation parameters comprises 2D sub-pixel matching means. 
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30. (Original) A system in accordance with claim 22, wherein said means for refining the in- 
plane rotation parameters comprises 1 D (one dimensional) interpolation means. 

31 . (Original) A system in accordance with claim 22, wherein said means for separately 
refining said out-of-plane rotation parameters comprises means for performing one or more ID 
searches. 

32. (Original) A system in accordance with claim 22, wherein said means for refining said out- 
of-plane rotation parameters (r,f>) comprises 1 D interpolation means. 

33. (Original) A system in accordance with claim 22, wherein said desired accuracy is sufficient 
to achieve a resolution of less than about 1 mm. 

34. (Original) A system in accordance with claim 21, wherein said 3D scan data comprise at 
least one of CT scan data, MRI scan data, and PET (positron emission tomography) data. 

35. (Previously Presented) A system in accordance with claim 22, wherein said means for 
performing a ID search for said out-of-plane rotation parameters comprises means for 
porfonning a similarity measure based on pattem intmsity. 

36. (Original) A system in accordance vdth claim 22, wherein said means for refining t 
translation parameters (x, y), said means for refining the in-plane rotation parameter ( 0), and 
said means for sqsarately refining said out-of-plane rotation parameters (r, ^ ) comprises means for 
performing one or more similarity measure^ 

37. (Original) A system in accordance with claim 22, flirther comprising means for processing 
said 2D x-ray image so as to match the orientation, image size, and bit depth of said x-ray image 
with the orientation, image size, and bit depth of said reconstructed image. 
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38. (Currently Ameaded) A caethod, comprising: 

acquiring x-ray images of a target volume in a first image plane and a second image 
plane, the x-ray images defining a present orientation of the target volume; 

generating synthetic x-ray reference images of the target volume firom S^dimensional scan 
data representing a previous orientation of the target volume, the synthetic x-ray reference 
images corresponding to in-plane transformations and out-of-plane rotations of the target volume 
projected onto the first image plane and the second image plane;-a&d 

determining a difference between the present orientation of the target volume and tlie 
previous orientation of the target volume in three translational coordinates and three rotational 
coordinates by comparing in-plane transformation parameters and out-of-plane rotation 
parameters of the x-ray images and the synthetic x-ray reference images, in the first image plane 
and the second image plane, wherein determining said difference comprises searching the in- 
plane transformation parameters in the first image plane and the second image plane using a first 
similarity measure betwera the x-ray images and the synthetic x-ray reference images in a 3- 
dimensional multi-level searc h: and 

aliening a radiation source to the target volume using the difference between the present 
ori^tation of the target volume and &e previous orientation of flie target volume . 

39. (Previously Presented) The meHiod of claim 38, wherein the in-plane transformation 
parameters comprise two in-plane translation parameters and one in-plane rotation parameter in 
each of the first image plane and the second image plane, and wherein die out-of-plane rotation 
parameters comprise two mutually orthogonal rotations wi& respect to each of the first image 
plane and the second image plane. 

40. (Previously Presented) The method of claim 39, fiixther comprising processing the x-ray 
images to match image properties of the synthetic x-ray reference images, wherein detcmiining 
the difference between the present orientation of the target volume and the previous orientation 
of the target volume further comprises: 

estimating the in-plane transformation parameters in the first image plane and the second 
image plane using a plurality of in-plane rotated synthetic x-ray reference images; 

searching the out-of-plane rotation parameters in the first image plane and the second 
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image plane in a 1 -dimensional search using a second similarity measure between the x-ray 
images and the synthetic x-ray reference images; 

refining the in-plane translation parameters in the first image plane and the second image 
plane using 2-dimensionaI sub-pixel matching between the x-ray images and the synthetic x-ray 
reference images; 

refining the in-plane rotation parameters in the first image plane and the second image 
plane using 1 -dimensional interpolation based on the in-plane translation parameters and the out- 
of-plane rotation parameters; and 

refining the cut-of-plane rotation parameters in the first image plane and the second 
image plane using a 1 -dimensional search based on the refined in-plane translation and in-plane 
rotation parameters using the second similarity measure. 

4L (Previously Presented) The mediod of claim 40, wherein the first similarity measure 
comprises a sum of absolute differences measure and the second similarity measure comprises an 
image pattern intensity measure. 

42. (Previously Presented) The method of claim 40, wherein the S-dimensional multi-level 
search comprises a four level search proceeding fi-om a low resolution search at a first level, 
through progressively higher resolution searches at a second level and a third level, to a highest 
resolution search at a fourth level, a resolution parameter at each level defined by low pass 
filtering the x-ray images. 

43- (Previously Presented) The method of claim 40, wherein processing the x-ray images to 
match image properties of the synthetic x-ray reference images comprises matching an 
orientation, an image size, and a bit depth of the x-ray images with an orientation, an image size, 
and a bit depth of the synthetic x-ray reference images. 
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44. (Previoxisly Presented) A system, csomprising: 

a radiation source and an imaging system to generate 2D radiographic images of a target 
volume in a first image plane and a second image plane, the 2D radiographic images defining a 
present orientation of tlie target volume; 

a 3D scan data generator to generate reconstructed 2D reference images of the target 
volume from 3D scan data representing a previous orientation of the target volume, the 
reconstructed 2D reference images corresponding to in-plane transfotmations and out-of-plane 
rotations of the target volume projected onto the first image plane and the second image plane; 
and 

a controller coupled with the radiation source, the imaging system and the 3D scan data 
gen^ator, the controller configured to: 

determine a differmce between the preset orientation of the target volume and the 
previous orientation of the target volume in three translational coordinates and three rotational 
coordinates by comparing in-plane transfbmiation parameters and out-of-plane rotation 
parameters of the 2D radiographic images and flie reconstructed 2D reference images in the first 
image plane and the second image plane, wherein to determine said difference the controller is 
configured to search the in-plane transformation parameters in the first image plane and the 
second image plane using a first similarity measure between the 2D radiographic images and the 
reconstructed 2D reference images in a 3-dimension^ multi-level search. 

45. (Previously Presented) The system of claim 44, wherein the in-plane transformation 
parameters comprise two in-plane translation parameters and one in-plane rotation parameter in 
each of the first image plane and the second image plane, and wherein the out-of-plane rotation 
parameters comprise two mutually orthogonal rotations with respect to each of the first image 
plane and the second image plane. 

46. (Previously Presented) The system of claim 45, the controller fijrthcr to process the 2D 
radiographic images to match image properties of the reconstructed 2D reference images, 
wherein to determine flie difference between the present orientation of the target volume and the 
previous orientation of the target volume, the controller is configured to: 

estimate tfie in-plane transformation parameters in the first image plane and the second 
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image plane using a plurality of in-plaae rotated reconstructed 2D reference images; to 

search the out-of-plane rotation parameters in the first image plane and the second image 
plane in a 1 -dimensional search ming a second similarity measure between the 2D radiographic 
images and the reconstructed 2D reference images- to 

refine the in-plane translation parameters in the first image plane and the second image 
plane using 2-dimensional sub-pixel matching between the 2D radiographic images and the 
reconstructed 2D reference images; to 

refine the in-plane rotation parameters in the first image plane and the second image 
plane using 1 -dimensional interpolation based on the in-plane translation parameters and the out- 
of-plane rotation parameters; and to 

refine the out-of-plane rotation parameters in the first image plane and the second image 
plane using a 1 -dimensional search based on the refined in-plane translation and in-plane rotation 
parameters using the second similarity measure. 

47. (Previously Presented) The system of claim 46, wherein the first similarity measure 
comprises a sum of absolute differences measure and the second similarity measiire oomprises an 
image pattern intensity measure. 

48. (Previously Presented) The system of claim 46, wherein the 3-dimensional multi-level 
search comprises a four level search proceeding fi^om a low resolution search at a first level, 
through progressively higjher resolution searches at a second level and a third level, to a highest 
resolution search at a fourth level, a resolution parameter at each level defined by low pass 
filtering the 2D radiographic images. 

49. (Previously Presented) The method of claim 46, the controller to process the 2D 
radiographic images to match an orientation, an image size, and a bit depth of the reconstructed 
2D reference images. 
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